Papers with hashtag segmentation
Multi-task Pairwise Neural Ranking for Hashtag Segmentation (P19-1)
Copied to clipboard
| Challenge: | Hashtags are used to add metadata to textual utterances, but their semantic content is difficult to infer as they often contain multiple tokens joined together. |
| Approach: | They propose to use a dataset of 12,594 hashtags to infer hashtag semantics . they propose to frame the problem as a pairwise ranking problem between candidate segmentations . |
| Outcome: | The proposed methods show 24.6% error reduction in hashtag segmentation accuracy compared to the current state-of-the-art method. |